Click any tag below to further narrow down your results
Links
PixelRAG converts web pages, PDFs, and images into screenshot tiles, embeds them using a fine-tuned Qwen3-VL model, and builds vector indexes for retrieval-augmented generation. It provides a CLI (pixelshot), pipeline commands for chunking, embedding, indexing, and serving (FAISS or Qdrant), plus a live API and a Claude plugin for visual search.
- PixelRAG ditches HTML parsing entirely, indexing screenshot tiles of pages/PDFs via a fine-tuned Qwen3-VL embedding model to preserve tables, charts, and layout
- Ships a pre-built index of 8.28 million Wikipedia articles, usable via a free live API or a ~217GB local download
- Includes a Claude Code plugin ("pixelbrowse") that lets Claude screenshot live pages and read diagrams/tables visually on request
- Supports both FAISS (simple/local) and Qdrant (disk-backed, quantized, multi-server) as swappable backends for scaling
Claire Gouze lays out a practical process to build and test a context layer your data agents can trust. She shows how to start small with dbt docs and markdown files, write evals, clean up data models, and iterate until you reach around 90% reliability.
- Adding query logs and profiling alone got the agent stuck around 40% accuracy; reworking the data model and documentation pushed it to 90%.
- Treat context like code: store it in files/markdown, version in Git, add CI/CD evals, and iterate on failure cases rather than plugging agents directly into raw databases.
- Start small—10 to 20 core tables with existing dbt docs—rather than trying to cover the whole warehouse at once.
- Evals should come from real BI query history or autogenerated question sets, reviewed by teams and tracked over time to build trust in the agent.
PixelRAG skips HTML parsing by taking screenshots of pages and indexing image tiles with a vision-language model. It preserves tables, charts, and layout lost by text extractors, outperforming a top text-based RAG by 18.1% on Wikipedia and offering a live-page Claude Code plugin.
- PixelRAG indexes screenshots of pages instead of parsed HTML text, using Qwen3-VL-Embedding over image tiles with a FAISS index across 30M+ Wikipedia screenshots.
- It beats the best text-based RAG system by 18.1% on text QA because it preserves tables, charts, and layout that HTML parsers often drop (40%+ of content lost) or flatten, swinging accuracy by ~10 points.
- Ships as a Claude Code plugin that screenshots any URL, PDF, or local site and feeds pixels to a vision-language reader, with a single setup script and no extra backend.
- A separate described retrieval approach cuts corpus size 40x, reduces tokens per query 3x, and boosts vector-search relevance 2.3x through smarter chunking, dynamic indexing, and adaptive scoring.
+ pixelrag
+ vision language models
retrieval augmented generation
+ claude
+ document indexing
+ ai
Yelp explains how it turned a two-week prototype into a scalable, production-ready AI assistant for business pages. They built near-real-time indices for reviews, photos, and structured data in an EAV schema, combined keyword-first retrieval with LLM prompts, and added query classification and trust-and-safety filters. The system streams answers with citations, logs metrics, and balances freshness, performance, and reliability.
- Yelp built its AI business-page assistant from two-week prototype to production in nine months by swapping Redis warehouse snapshots for streaming ingestion, keeping reviews, photos, and core business data fresh within 10 minutes (menus/community posts still update weekly).
- An EAV schema in Cassandra lets them add new structured fields on the fly without schema migrations.
- Combining keyword-first retrieval with LLM-based query expansion hit quality targets faster than pure embedding-based search.
- Batching only the slow-moving data sources (rather than everything) kept the real-time streaming pipeline manageable.
This article explains AutoRAG, a framework designed to improve Retrieval-Augmented Generation (RAG) systems by treating their design as an optimization problem. It highlights the importance of evaluating entire pipelines rather than focusing on isolated components, emphasizing how effective query reformulation and context expansion enhance answer quality.
- AutoRAG treats RAG pipeline design as a search/optimization problem over components (chunking, query formulation, retrieval, context presentation) rather than something you configure by intuition.
- Query decomposition breaks complex queries into simpler sub-queries to improve precision of fact retrieval.
- Combining dense embeddings with sparse methods like BM25 in a hybrid approach outperforms relying on either alone.
- Passage augmentation (pulling in adjacent passages, not just top hits) and prompt structuring to counter the "Lost in the Middle" effect both meaningfully improve answer quality.
This article discusses BGE-M3, a new AI model that improves how AI systems retrieve and understand information. It addresses the limitations of traditional methods by combining speed, precision, and context, ultimately reducing inaccuracies in AI-generated responses.
- BGE-M3 unifies Dense, Sparse, and Multi-Vector retrieval in one model instead of requiring separate systems for speed and precision.
- Multi-Vector mode compares every query word to every document word, preserving detail that single-vector compression would lose.
- This combined approach directly targets RAG's "semantic gap" problem, reducing hallucinations by balancing speed, accuracy, and context depth.
Organizations are increasingly faced with the decision of whether to implement Retrieval-Augmented Generation (RAG) or fine-tuning for their AI initiatives. RAG connects large language models to external databases, allowing access to real-time information, reducing inaccuracies, and enhancing security and traceability. However, implementing RAG comes with its own technical challenges that require careful planning and maintenance.
- RAG connects LLMs to external data sources so responses reflect real-time information rather than static training data
- Grounding responses in retrieved data cuts down on hallucinations and improves accuracy
- RAG offers added benefits like source traceability and better security for proprietary data
- Setting up RAG requires substantial infrastructure work—data pipelines, indexing, and ongoing maintenance for quality and scalability